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Introduction 


▼  The  Officer  of  the  Deck 

■  “The  Officer  of  the  Deck  (OOD)  occupies  a  unique  position  in  a  naval  ship. 
Nowhere  in  military  or  civilian  life  is  there  a  parallel  to  the  range  and  degree  of 
responsibility  that  is  placed  in  the  hands  of  the  OOD.  As  direct  representative  of 
the  Captain,  he  or  she  acts  with  all  the  authority  of  command  and,  next  to  the 
Captain  and  the  Executive  Officer  (XO),  is  the  most  important  person  on  the 
ship”  (Stavridis  &  Girrier,  2007). 

■  Qualification  process  involves  Personnel  Qualification  Standards  (PQS)  that 
primary  concentrate  on  technical  skills  and  knowledge. 
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Definitions 


▼  Nontechnical  Skills 

■  “Cognitive,  social,  and  personal  resource  skills  that  complement  technical  skills, 
and  contribute  to  safe  and  efficient  task  performance” 

▼  Behavioral  Markers 

■  “Observable,  nontechnical  behaviors  that  contribute  to  superior  or  substandard 
performance  within  a  work  environment” 
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Example  Behavioral  Marker  Systems 


Categories 

Elements 

Example  Behaviours 

COOPERATION 

Ir-  iiii  tii  ill': ling  .Hid 
nuiJni  .Tinlng 

inutihcs  ibauiptirxR  lor  open  :  arrar.intfu  |r.r, 
2ld  |iaFj|jpCIUEH1 

Cl  >nsi  ril  ltI  jig  cAl  ten. 

Tatafimfflirai  .jT  Ktur-crr-w  mr-mlxins 

Iota -admit 

Supporting  cithers 

I9c!c»  Mlmrcins*  m.-nili’  r.  lr. 
'JrjTuunUrg  til  i  Lilian 

CanfUr:  salving 

C  riiLi  nLiinii  cci  uttm  is  njhi  railsr 
linn  ioo  b  hub 

LEADERSHIP  & 

MANAGER! M 

SKILLS 

Use  i>r  ii  .1'.  and 

jftH.Tl1vrri«j; 

Tdiiiis  liiliiiLm:  La  ’.yiuili:  Invafnnnort  and  Lask 
mwyUMlnn 

M.'^ni  ru  iu  iu.  Si  miditrds 

Imnn  linns  If  Usk  :;uiipli.1.km  Inftaus  fr»im 
standards 

Planning  mid  arclim' ijl-j. 

"liily  mi  's  inir  ana  gciiS 

Workload  manage’ mens 

AUdcucs  cnojRh  Urns;  id  mnuln*  main 

SIHIAI30K 

AWARENESS 

Sib  leni  nwiirenesa- 

Mcifii.i  s.Tl  nrpon  clung  es  Li  iyr  ■  ni  staLm 

En’rirarmMsilal  .ii.var-me.H 

ri:Jcn  jila-ir-uiar  aim  .i  the  EfTnlmnnxr.i 

.Vp_Li..|:  j'jaa 

l:lrjujii«  packcto  ■  fuJur-i  pcrii-Lans 

Pn  itil'-m  deljnlUcin  ■' 
diagnosis 

Biwrn  casual  laecrs  w-iili  uthrr  mrw  tncoilitra 

DECISION 

MAKING 

L'tnlc  n  generation 

Stsers  atniYudw!  c>  .trees  nr  addon 

Asks  ijtlirr  or;w  n:>ml:,-r  rornpUarc 

Risk  liss'ajcnf-rrl  - 
Option  cholDK 

Gaixidon  mid  share  rbks  nr  u  rirrn:lvc 
od  linos  or  inJnn 

OtLlrome  review 

ihcEtaonLcimKi  igairc:  ;.!:m 

Very  Roar 

Faar 

Acctp  table.1 

Goad 

V«j  Good 

QbsrrrTd  behaviour 
dimcPy  pndmi;.-cn 

JUgfcs  SIlTCLV 

uteicrKKl  brJuntcur 
in  id  her  rtnillj.-T, 
rr-itc  '.  .n  Jcnucr  nigh- 
ufesy 

OfcBiin™!  t-vjLJMOIlJ 

does  n  ii  Ktdangpr 
ni|jts  salriv  but 
du£  ImpravcniciE 

Oliss.TDd  dtiiailDii!' 
raihaneoi  niu.b  itTiiLj 

OKf.'llI  IKtUTlDlir 
■'.i|iLxiis_Lf  .Yitunccs 
night  aJrb  and  o»U 
wfiu  as  ,ir  c^nijili! 
Ca  iL'irr  pu:c! 

5 


,MV'S  [nfa, 


Qom/oj 


srmARi 

v  v  ” 

A 


$ 


Example  Behavioral  Marker  Systems 


Hospital . . . . . . . .  Trainer  name  . . . . .  Date  . 

Trainee  name  . .  Operation 


Category 

Category 

rating’" 

Element 

Element 

tating* 

teed  back  on  performance  and  debriefing  notes 

Sitietion  Awareness 

Gathering  irtformatior 

Undemanding  information 

I'rnjeoring  and  anticipating  future  dare 

Decision  Making 

Consider  ng  options 

Selecting  and  oommunlcating  option 

hiplernenthg  andrevlewhg  decisions 

Conimmication  and 

1  earn  work 

LjicKiiifjirj  irf  ormatlor 

L4.il  -li-Ji  ing  a  sh  ared  n  nd  ereta  ndln  g 

Co-ordinating  team  activities 

Leadership 

Settin  g  a  nd  main  Minin  g  stan  dard  s 

kpporfhg  others 

Coping  with  preside 

*1  Poor;  1  Marghal;  3  Acceptable  4  Good  N.'A  Not  Applicable 

1  Pan  ter farmancE  endanger  ed  or  fro  tnl  iallf  endangered  pa  den  t  safely,  set  ia  is  remediation  K  requi ed 

2  Marginal  tier  hrmance  h  die  ated  cause  lor  concern  considerable'  improvement  is  rie^xle^J 

3  AccEp  6  hie  I'er  form  an  ce  was  of  a  sa  thfer  tor >  standard  but  cor ild  be  hp  roved 

4  Good  Perform  an  oe  w  as  oF  a  coislaently  hig  h  sta  nda  nl ,  en  han  dn  g  palie  nr  safety  it  cmild  Ije  n  serf  as  a  positive  m  am  pfe  for  olh  ere 

Ni'A  Not  AppliQ  He 
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Method 


▼  Literature  Review 

■  Create  an  exhaustive  list  of  nontechnical  skills 

▼  Focus  Group 

■  Refine  the  list  of  nontechnical  skills  and  identify  individual  elements 
T  Interviews 

■  Gather  real-life  data  to  test  the  reliability 

▼  Inter-Rater  Reliability  Testing 

■  Test  the  reliability  of  the  taxonomy 
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Literature  Review 


Assertiveness 

Leadership 

Communication 

Management  skills 

Co-operation 

Managing  stress 

Coping  with  fatigue 

Situational  awareness 

Decision  making 

Task  management 

Energy 

Team  working 

Forehandedness 

Vigilance 

Intuition/ experience 

Judgment 

Workload  management 
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Focus  Group 


Nontechnical  Skill  Category 

Elements 

Leadership 

Establishing  Authority 

Managing  Workload 

Maintaining  the  Standards  of  the  Watch 

Decision  Making 

Defining  the  Problem 

Generating  Possible  Solutions 

Implementing  Best  Solution 

Situational  Awareness 

Actively  Gathering  Information 

Responding  to  Changes  in  Information 

Anticipating  Future  Events 

Communication 

Selecting  Correct  Medium 

Sending  Information  Clearly  and  Concisely 

Effectively  Receiving  Information 

Managing  Stress 

Maintaining  Concentration 

Coping  with  Stressors 
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Interviews 


T  The  OOD  went  back  to  the  bridge  wing  to  look  at  the  contact  again. 

T  The  OOD  reported  both  contacts  to  the  CO  prior  to  being  relieved. 

T  Once  the  ship  was  officially  called  into  its  waiting  station,  the  OOD  gave  the  order 
to  proceed. 

T  The  OOD  never  called  the  oiler  to  state  his  intentions. 

▼  Once  the  ship  was  only  500  yards  off  the  oiler's  bow,  the  OOD  ordered  the 
Conning  Officer  to  match  the  oiler's  course  and  speed  to  avoid  a  collision. 

T  The  OOD  did  not  use  the  wind  envelope  manual  to  prepare  for  helicopter 
operations. 

T  The  OOD  continued  to  look  at  the  radar  scope  instead  of  looking  out  the  windows 
to  see  if  they  were  approaching  the  oiler  too  fast. 

T  The  OOD  did  not  know  that  the  ship  was  four  miles  left  of  track. 

T  The  OOD  ordered  the  bridge  team  to  stop  approaching  the  other  vessel. 

T  The  OOD  told  the  XO  that  they  were  not  approaching  the  correct  vessel. 
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Inter-Rater  Reliability  Testing 


Nontechnical  Skill  Category 

Elements 

Leadership 

Establishing  Authority 

Managing  Workload 

Maintaining  the  Standards  of  the  Watch 

Decision  Making 

Defining  the  Problem 

Generating  Possible  Solutions 

Implementing  Best  Solution 

Situational  Awareness 

Actively  Gathering  Information 

Responding  to  Changes  in  Information 

Anticipating  Future  Events 

Communication 

Selecting  Correct  Medium 

Sending  Information  Clearly  and  Concisely 

Effectively  Receiving  Information 

Managing  Stress 

Maintaining  Concentration 

Coping  with  Stressors 

k  =  .43 
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Inter-Rater  Reliability  Testing 


Nontechnical  Skill  Category 

Elements 

Leadership 

Managing  Workload 

Managing  Stress 

Decision  Making 

Considering  Options 

Balancing  Risks 

Implementing  and  Reviewing  Decisions 

Situational  Awareness 

Actively  Gathering  Information 

Responding  to  Changes  in  Information 

Anticipating  Future  Events 

Communication 

Issuing  Orders 

Following  Orders  and  Procedures 

Providing  Information 

k  =  .65 
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Inter-Rater  Reliability  Testing 


Nontechnical  Skill  Category 

Elements 

Leadership 

Managing  Workload 

Managing  Stress 

Decision  Making 

Analytical  Decision  Making 

Following  Orders  and  Procedures 

Intuitive  Decision  Making 

Situational  Awareness 

Actively  Gathering  Information 

Responding  to  Changes  in  Information 

Anticipating  Future  Events 

Communication 

Issuing  Orders 

Providing  Information 

Receiving  Information 

k  =  .70 
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Inter-Rater  Reliability  Testing 


Nontechnical  Skill  Category 

Elements 

Leadership 

Managing  Workload 

Managing  Stress 

Analytical  Decision  Making 

Decision  Making 

Following  Orders  and  Procedures 

Intuitive  Decision  Making 

Gathering  Awareness 

Situational  Awareness 

Understanding  Awareness 

Anticipating  Future  Events 

Communication 

Issuing  Orders 

Providing  Information 

K  = 

.91 
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The  Nontechnical  Skills  for  Officers  of 
the  Deck  (NTSOD)  System 


Ship 

Trainee 

Watch 

Date 

Assessor 

Evolution 

Category 

Category 

Ratings 

Dement 

Element 

Rating* 

Notes 

Leadership 

Managing  Watch  Team 

Coping  with  Stress 

Communications 

Providing  Information 

Issuing  Orders 

Situational 

Awareness 

Gathering  Awareness 

Understanding  Awareness 

Anticipating  Future  Events 

Decisiou  Making 

Analytical  Decis  ion  Making 

Following  Orders  &  Procedures 

Intuitive  Decision  Making 

*  1  -  Unsatisfactory,  2  -  Marginal:  3  -  Satisfactory.  4  -  Outstanding:  NO-  Not  Observed 


1  -  Unsatisfactory  Watchstander  could  endanger  ship  and  crew  without  considerable  improvement 

2  -  Marginal:  Watchstander  requires  improvement. 

3  -  Satisfactory  Watchstander  performed  at  an  acceptable  level,  but  room  for  improvement  exists 

4  -  Outstanding  Watchstander  performed  at  a  consistently  high  level. 

N  O  -  Not  Observed  Element  or  skill  was  not  observed  during  tins  evolution. 
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Statement  Distribution 


Nontechnical  Skill 

Skill 

Percentage 

Element 

Element 
Percentage 
Inside  Skill 

Element 

Overall 

Percentage 

Leadership 

12.1% 

Managing  Watch  Team 

44.4% 

5.4% 

Coping  with  Stress 

55.6% 

6.7% 

Communications 

28.2% 

Providing  Information 

33.3% 

9.4% 

Issuing  Orders 

66.7% 

18.8% 

Gathering  Awareness 

66.1% 

26.2% 

Situational  Awareness 

39.6% 

Understanding  Awareness 

25.4% 

10.1% 

Anticipating  Future  Events 

8.5% 

3.4% 

Analytical  Decision  Making 

53.3% 

10.7% 

Decision  Making 

20.1% 

Following  Orders  and  Procedures 

40.0% 

8.1% 

Intuitive  Decision  Making 

6.7% 

1.3% 

16 


